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1.  Introduction. 

Hewitt  and  Savage  [6]  have  shown  that  finitely  additive  exchangeable 
probabilities  on  a  product  space  are  integral  averages  of  power  product 
probabilities.  They  prove  this  result  as  a  corollary  to  their  theorems 
on  the  countably  additive  case.  This  note  adapts  their  technique  to  the 
study  of  more  general  invariant  probabilities.  From  results  of  Farrell 
[L]  and  Choquet  and  Feldman  ( [7 ] ,  Section  10)  it  is  concluded  that 
finitely  additive  invariant  probabilities  are  averages  of  finitely  addi¬ 
tive  ergodic  probabilities. 

In  a  countably  additive  context  it  seems  necessary  to  impose  restric¬ 
tions  on  the  Borel  field  being  studied  and  on  the  maps  used  to  define 
invariance  and  ergodicity.  Relaxing  the  assumptions  of  one  type  must  be 
balanced  by  strengthening  those  of  the  other  (in  addition  to  [4]  and  [7], 
see  [l]  and  [12]).  Here,  however,  the  field  of  sets  can  be  arbitrary, 
and  the  maps  are  assumed  only  to  be  measurable.  Rather  than  state  a 
host  of  theorems  which  can  be  proved,  one  particular  case  is  proved  in 
detail.  Later  on  it  is  explained  how  the  techniques  can  be  applied  to 
other  problems.  Several  definitions  of  ergodicity  are  proposed  and  related 
to  the  one  used.  The  final  section  contains  a  subjective  probability 
interpretation  of  invariance  and  ergodicity. 

Prepared  with  partial  support  of  U.S.  Army  Research  Office  Grant 
DA-AR0(D)~31-124-G726. 
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2. 


A  Representation  Theorem 


A  homomorphism  from  one  field  of  sets  to  another  is  a  map  -which  pre¬ 
serves  finite  unions,  finite  intersections,  and  complements.  The  notions 
of  isomorphism  and  automorphism  are  defined  in  the  obvious  ways.  A 
0-homomorphism  (isomorphism,  automorphism)  in  addition  preserves  countable 
unions  and  intersections. 

Assume  ft  is  a  set,  y  a  field  of  subsets  of  ft,  and  T  a  1-1 

bi-jA- measurable  map  of  ft  onto  ft.  T  and  its  powers  can  be  viewed  as 

automorphisms  of  ?.  A  finitely  additive  probability  p  on  1  is  said 

to  be  invariant  if  p(A)  =  p(T  A)  [=  p(T"  A) ,  n  =  ±1,±2...]  for  all  A  e  3) 

p  is  ergodic  if  there  do  not  exist  &  >  0  and  A^,A^, . . .  e  J  for  which 

S  <  p(A  )  <  1  -  8,  lim  p(A  A  A  )  =  0,  and  p(A  A  T_1  A  )-*  0 

m,  n-»oo 

(A  denotes  symmetric  difference).  Let  (5-)  [e(^)  ]  be  the  set  of  finitely 
additive  invariant  [ergodic]  probabilities  on  $  and  let  be  the  smallest 
0-field  of  subsets  of  €,(3)  containing  all  sets  of  the  form 
{ V 1 V  e  e(^),  V ( A)  <  a],  where  0  <  a  <  1,  and  A  is  a  fixed  set  in  3. 

(1)  THEOREM,  ^3(3)  is  not  empty.  For  each  p  e  ^(v?)  there  is  a  unique 
countably  additive  probability  A  on  ~8  satisfying 

(2)  p(A)  =  r  v(A)  d\(v) 

for  all  A  e  (it  is  clear  that,  conversely,  if  for  a  finitely  additive 

probability  p  on  ^  there  exists  a  X  on  ^  satisfying  (2)  for  all 
A  e  3,  then  p  e  3(3)  • ) 

PROOF.  By  Stone's  representation  theorem  for  Boolean  algebras 
([11],  Section  8)  there  is  an  isomorphism  cp  of  3  onto  the  field 
of  compact  open  subsets  of  some  compact,  totally  disconnected  Hausdorff 
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space  S.  Call  S  "the"  Stone  space  of  3",  any  two  such  are  homeomorphi c . 
For  B  e  O  define  UB  =  cp  ^(cp  ^B)j  .  Of  course  U  and  its  powers  are 
automorphisms  of  O'.  Moreover,  there  exists  a  homeomorphism  \|r  of  S 
with  itself  for  which  \|/  =  UB  for  all  B  e  O'  ([ll],  Section  ll)  . 

Let  a(O)  be  the  a- fie Id  generated  by  0 ;  it  is  essential  to  notice 
that  a(0>)  is  the  Baire  cr-field  of  S  {[^>],  P*  221).  Because  \|r  and 
\Jr  take  Baire  sets  to  Baire  sets,  U  can  be  extended  uniquely  to  a 
cr-automorphism  of  o(&)  .  ^(0)  and  s(3)  are  in  obvious  1-1  corres¬ 
pondence  with  and  respectively.  Each  finitely  additive 

probability  q  on  G  is  in  fact  countably  additive,  and  so  admits 
unique  extension  to  a  countably  additive  probability  on  c r(0) .  To  see 
this,  it  is  enough  to  demonstrate  that  B^,Bg,...  in  O  and 

B,  =)B  o  ...,  h  B.  =  0  imply  ij(B  )  -*  0  ([5],  pp.  39  and  5^)  •  But 
1  i=l  1  1 

this  condition  is  trivially  satisfied,  for  since  the  B's  are  compact 
and  have  void  intersection,  some  B^  is  already  void. 

Recall  that  if  r)  is  any  countably  additive  probability  on  cr(0) 
and  for  A,B  e  cr(O0,  the  distance  from  A  to  B  is  defined  to  be 
r](AAB)j  then  cr(0)  Is  a  complete  semi -metric  space,  and  moreover  that 
every  member  of  the  space  is  the  limit  of  a  Cauchy  sequence  of  elements 
of  0.  Easy  consequences  of  these  facts  are  as  follows: 

(a)  J(O)  = 5  (b)  if  V  e  then  v  e  S (0)  iff  there 

does  .not  exist  B  e  a(0)  for  which  v(B  A  UB)  =0,  0  <  v(B)  <  1.  The 
existence  of  such  a  B  implies  that  of  a  C  satisfying  UC  =  C, 

0  <  v(C)  <  1  —  for  example,  take  C  =  limsup  U^S. 

An  argument  given  by  Choquet  (see  [7],  pp.  8l-2)  and  (a)  imply  -JH3) 

i 

is  nonempty.  Briefly,  the  set  of  all  finite,  signed,  countably  additive 
Baire  measures  on  S  can  be  viewed  as  the  dual  space  of  the  Banach  space 
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of  continuous,  real-valued  functions  on  S.  With  those  measures  given 


Tn 


the  weak*  topology,  the  maps  U  ,  n  =  0,+l,+2,...  induce  continuous 

linear  transformations  of  the  (compact,  convex)  set  of  countably  additive 

probabilities,  'P,  onto  itself.  .  And  >i(a(0)^  is  the  subset  of  'P 

n 

consisting  of  fixed  points  for  the  maps  U  ,.  The  Markov-Kakutani  fixed 
point  theorem  ([3],  p.  4.56)  implies  <=2^a((3')'j  is  not  empty,  and  hence 
that  v£>(j?)  is  not  empty. 

In  view  of  the  existence  of  \|r,  (a),  the  remark  following  (b),  and 

a  theorem  of  Farrell  ([4],  p.  46o),  for  each  p  e  3(0)  there  exists  a 
unique  (countably  additive)  probability  k  on  the  a-field  of  subsets  of 
C(&)  generated  by  sets  of  the  form 

{ ri  1  rj  e  &(&) ,  T)(C)  <  CHj  0<CC<1,  Ce  a(6)  }  satisfying 


(3)  n(B)  =  f  -n(B)  dk(ii) 

Jzip) 

for  each  B  e  o(0)  .  In  particular  (3)  holds  for  each  B  e  O'.  Yet  for 
such  B,  r|(B)  viewed  as  a  function  of  T)  e  e(0)  is  measurable  with 
respect  to  the  a-field  2?  generated  by  sets  of  the  form 
{■nh  e  &(&) ,  rj  ( C )  <Ol;  0  <  Ci  <  1,  C  e  O'}.  Thus  for  B  e  O',  k  can  be 
cut  down  to  ~8,  and  (3)  still  holds.  But  now  (l)  follows  in  view  of 
the  correspondence  between  2?  and  ,  3(0)  and  *3(3),  and  C(O)  and 

eC7).  | 


Of  course  the  definition  of  &(-?)  is  contrived  so  that  S,(3) 
corresponds  to  countably  additive  probabilities  on  o(0)  which  are 
ergodic  in  the  usual  way.  And  it  is  implicit  in  (2)  that  Z(3)  is  the 
set  of  extreme  points  of  '3(3)  .  Yet  it  may  be  of  interest  to  see  what 
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becomes  of  other  definitions  of  ergodicity  when  applied  to  (ft, 3) •  For 
example,  p  e  J>(-3)  might  be  called  ergodic  if  there  does  not  exist 
A  e  3  for  which  A  =  T  ^A,  0  <  p(A)  <  1.  That  this  would  have  been 
ridiculous  is  clear  from  the  following  example.  Let  ft  be  the  set  of 
bilateral  sequences  of  0's  and  l's,  be  the  smallest  field  contain¬ 

ing  the  cylinders,  and  T  be  the  shift.  It  is  easy  to  verify  that  ft, 
and  0  are  the  only  members  of  3  in  variant  under  T  and  so  every 
member  of  J*(3)  would  be  ergodic  by  this  definition.  (With  ft  given 
the  ordinary  product . topology,  i  is  a  base  of  compact  open  sets,  and 
so  ft  is  its  own  Stone  space.) 

It  may  seem  reasonable  to  call  p  e  J(3)  ergodic  if  there  does  not 
exist  B  e  3  for  which  p(B  A  T  ^B)  =0,  0  <  p(B)  <  1.  Unlike  the 
case  with  o(& )  and  U,  this  definition  is  not  identical  to  the  one  just 
discussed,  and  it  is  true  that  a  p  not  ergodic  in  this  sense  is  not 
ergodic  according  to  the  definition  adopted.  Probabilities  ergodic  in 
this  sense  need  not  be  extreme,  in  however,  as  is  illustrated  by 

an  example.  Let  (ft, 3)  be  as  in  the  previous  paragraph.  Suppose  p 
is  a  measure  on  induced  by  any  sequence  of  exchangeable  random 
variables  which  are  neither  independent  nor  with  probability  one  either 
identically  0  or  identically  1.  Then  it  follows  from  deFinetti's 
theorem  ([2],  Chapter  k;  [6],  p.  486)  that  the  only  sets  B  e  3  satis¬ 
fying  p(B  A  T  ^B)  =0  are  ft  and  0,  and  that  p  is  not  extreme  in 
the  power  product  probabilities  on  ft,  let  alone  in  . 

3 •  Generalizations . 

Apparently  several  times  in  Section  2  T-"*-  or  was  considered 

when  reference  to  the  inverse  was  unnecessary.  The  reason  for  this  was 


5 


to  keep  notation  consistent  with  that  of  more  general  problems  than  the 
one  being  studied.  What  follows  is  an  outline  of  several  results  similar 
to  (l),  some  generalizations  and  some  not  comparable.  The  interested 
reader  will  have  no  trouble  filling  in  the  details  himself. 

Suppose  ft  is  a  set,  J  a  field  of  subsets,  and  *7  a  family  of 

./-measurable  maps  of  ft  into  itself.  Then  T  e  J  implies  T  1  can  be 
viewed  as  a  homomorphism  of  3  (though  the  same  is  not  necessarily  true 
of  T)  .  A  finitely  additive  probability  p  on  /  is  in  J){^)  if 
p(A)  =  p(t"’'LA)  for  each  T  e  3  and  A  e  /  ;  it  is  in  e(s7)  if  there 

do  not  exist  8  >  0  and  A^,A  , . . .  e  3  for  which  8  <  p(A^)  <  1-8, 

lim  u(A  A  A  )  =0,  and  p(A  A  T  ^A  )  -»  0  for  each  T  e  J. 
m,n-»  n  m'  n  n' 

Again  the  Stone  space  argument  can  be  employed.  If  U  on  O  cor¬ 
responds  to  T  '*',T  e  3 ,  there  may  not  be  a  homeomorphi  sm  of  the  Stone 
space  corresponding  to  U,  but  at  least  there  is  a  unique  continuous 
map  i  of  S  into  S  satisfying  UB  =  |  for  each  B  e  O'  ( [ 11 ] , 

p.  32)'  Hence  the  results  of  Farrell  ([4],  p.  460)  and  Choquet  and  Feld¬ 
man  ([7],  pp.  82-3 )  apply  to  yield  a  number  of  theorems  similar  to  (l). 

Of  course,  that  3^3?)  is  not  empty  does  not  follow  from  the  Markov - 
Kakutani  fixed  point  theorem  unless  the  maps  in  ^7  commute  under  composi¬ 
tion.  Yet  other  fixed  point  theorems  can  be  employed  in  specific  situa¬ 
tions  (see  [8],  Section  [3 ]  P •  457)- 

With  the  definition  of  ergodicity  given  in  this  section,  every  member 
of  Z(3)  is  an  extreme  point  of  .  And  the  present  definition  is 

analogous  to  that  of  Phelps  ([7],  p.  8l)  .  Farrell's  definition  would 
have  p  e  JL(3)  ergodic  if  there  does  not  exist  B  e  cr((7)  satisfying 
both  B  =  UB  for  each  U  on  a(GQ  (corresponding  to  a  T  ’*’)  and 
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0  <  v(B)  <  1,  where  V  on  o(ff)  corresponds  to  p  e  .  For  con¬ 

ditions  that  a  p  ergodic  in  Farrell’s  sense  be  in  Z{3)  see  ([4], 
p.  452;  [12],  pp.  196-7).  I  n  general  his  definition  is  not  equivalent  to 
either  definition  mentioned  in  the  last  section. 

It  seems  pointless  to  present  a  catalogue  of  representation  theorems 
including  results  on  the  nonemptiness  of  J>(-3)  and  the  uniqueness  of  the 
representation.  But  perhaps  one  striking  fact  deserves  mention.  Namely, 
the  existence  of  a  representation  of  the  form  (2)  requires  not.  only  no 
assumptions  on  and  J,  but  also  no  assumptions  on  the  maps  -J  other 

than  their  measurability.  The  only  qualification  is  this.  If  0(0)  is 
not  weak*  closed  in  d?(cs(0) J,  the  a-field  'S  in  (l)  must  be  enlarged 
in  a  manner  similar  to  that  described  by  Bishop  and  deLeeuw  (see  [7], 
pp.  51  and  83;  [6],  p.  48l) . 

4 .  An  Interpretation. 

One  reason  for  being  interested  in  finitely  additive  probabilities 
is  a  sympathy  with  the  notion  of  subjective  probability  ([2];  [ 10 ] ) - 
Thus  it  may  seem  interesting  that  the  definitions  of  invariance  and  ergo- 
dicity  used  here  have  subjective  interpretations.  For  purposes  of 
illustration,  assume  again  that  Q,  J ,  and  T  are  as  in  the  examples 
of  Section  2.  Each  p  on  determines  a  law  for  the  coordinate  pro¬ 
cess  Xn(w)  =  w(n),  the  n-th  coordinate  of  to.  If  p  represents  your 
beliefs  about  X  ,  then  p  is  invariant  for  you  if  the  probability 
Xn(w)  =  0  (and  hence  the  probability  Xn(<o)  =  l)  does  not  depend  on  n. 
p  is  ergodic  for  you  if  there  is  an  e  >  0  for  which  no  pattern  of  0’s 
and  l’s  of  finite  length  j  (j  =  1,2,...)  has  the  following  property. 
Your  probability  that  (X^,X^, . . . ,X^ )  exhibits  the  pattern  is  strictly 
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between  0  and  1.  But  you  are  sure  to  within  probability  £  that 


,X^>  .  .  .  will  also. 

By  contrast,  the  frequentistic  notion  of  ergodicity  ([9],  pp.  104-5) 
involving  averages,  figuring  in  the  ergodic  theorem  does  not  fit  comfortably 


(X, ,X , . . . ,X. )  will  exhibit  the  pattern  iff  (X,. 


into  the  framework  of  subjective  probability  (cf.  [2],  Chapter  VI ;  [10], 
Chapter  3 ) • 
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